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(54) CAMERA SYSTEM AND VIDEO SIGNAL PROCESSOR 
(57)Abstract: 

PROBLEM TO BE SOLVED: To provide a video signal 
processing method that can reduce a circuit scale and 
the power consumption of the camera system, improve 
the processing speed and reduce the number of times of 
access to a memory as its contribution. 
SOLUTION: In the camera system employing a CCD 
image pickup element 1 1 for an image pickup device, a 
memory 14 such as a DRAM directly stores raw data 
once that are outputted from the CCD image pickup 
element 1 1 and converted into digital data by an A/D 
converter 13 via a correlation double sampling 12 (CCD 
Raw data). Then the CCD Raw data are read from the 
memory 14 in the unit of blocks, a camera signal 
processing section 21 applies camera signal processing 

to the data and a reduction processing section 22 conducts reduction processing and a 
compression processing section 23 applies compression processing to the data after the 
camera signal processing in the unit of blocks. 
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7fi*«ya«2 i -c*t« 9«-g-*aa«rtr5 1 £ 

«/h««» 2 2 "C <DJB/hte»*ffl«*Qi3Iffl 2 3 *Ctf>EE*g 
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i^ffl v n p»ks ^ * y ufc r £ ^«pf& t -raw** 

[fB*« 3 ] fflGft«A»liiKrto««!aA»#^ u 

[»**4 ] y v^e- wm, fi9fe@ft«& 
si»a*aaEifS tw-t* d t t -r 1 e« 

tt*0>nkffi «<E>*£&*ttl L/c fc * 9 ffl Li® 

y tmmsttbwmRnmfr* 

/h» J: 5 t>/h $ < K£f 6 r t £#18 fc 4 IE 

7o fc fcWfcffi/K Bflffi*g£>&a£ 

[0001] 
[0002] 

t?!l;tfi£C CD (Charge CoupledDevice) SMfciS^ 

So 

[0 0 0 3] rOttJfcWfcflia** 7^7Afl CC 

DSft^io i, fturst^yy^ (CDS) B 

^102, AD=x>v<— * 10 3, 7^W^yi0 




4, ri^WS^fea (dsp) SKi 0 5*3*1/;** 

#*&SlE]SS 1 0 5 tt, 0 1 3IC^-fct 9l-> Xty^ 

teasei 1 u */h»aai 1 2^xx^sm/wnm 

Ul 1 3^ICioT«fig$^TV>5o 
[0 0 0 4] tttf&tD&jMiC&ZXtyisXTMz. 

«**>«*«\ m\ 4©j:5ftnw-eiH*-r*. roc 
cDi«^i 0 i©aa«*Hu **>ma»-c©!>* 

OKI 0 2^|&££*trt:&s AD^y/Wl0 3r7 
S>*/Wfc**U 1 0 4«ri*LT7^;W 

m^-teaiEiK 1 0 5 \cm&zfiz 0 
[0005] ::-c, ccDi**f lOi^blHAS 

*K tlBi-fif-^y ^^0Kl 0 2SrgTDAny^ 
1 0 3^S>*Mfc$ttfc£'7 f -**\ CCDRaw 

[0 00 6] r S^Wt^J&aisIK 105 KlfcVvf, # 
1 1 CCDRaw *f-**m&T 

-*Y*5j:tffiig7 f -*CbCr (EAT* YCbCrr 
-*iE*-) *\ R <#) G OR) B (*) r^lC^ 

ifci-sfeaa^TfeftSo kbs 

[0007] 1 5 (£\ 7^^^y 104 Oft^tt* 

m&m&m-t* :««-eit 7 >f von 

^7-^M^$C^^> 4*07K¥^^ 

>f ^^ty 1 2 1-1 24*5fflv^^lii:ft$o r 
[0 0 0 8] iJ^y^^mUl l 1W*^7 

(xr*. teao®^jct>, mi 6jc^i-<t5Jc, 

oT^fco ^^>7>f >-oii^icov> 

X^(D±T3y^( yfrxDffimv*-* Srfflv^a»&Sr« 

^ey 1 3 1-1 3 6#/Ev><b*vcv>5o 

[0 0 0 9] 

te*) tea^pR^, --i-x^r ^7>r»^y (w® 
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Kf*l#-2 0#g&&g-?fc!^ Lfc#otBB** 
CCDlt^i 0 l<Dli^3S:d5iifti-r^iconT7K¥ 
[0010] *fc, s«/#JUUMi i 3-ej pe 
i i^tt^&aLfc7-*£-j.^y 

l o 6 fcUHAU *ft*ffi«*aic:£*>*fcT Ku*"C 
»*ffl"i-rtlcJ;oT£EJIB*aa*tTo-CV^fcft, &a 

little, JPEG^MPEG^gfelUfcf-^S:- 
5.y*y 1 o 6fcttfttU *ft*«>h/tt*»aK'&to 

tffcr Ku^-eflE^aurv^fc*, *afc»iiw*a»*» 
otitic, i o 6^r^*^isijRt>#<raH 

[0 0 11] ±EWMK«*T4$*ifcfc© 

Ktt&aiitf ©*«ftfi±*5 .fctf* * y ^r^t^s 

[0 0 12] #38WHt*e>l^ ^fA©@BjB«©i 
/hffcteJ;tMEil»«a{k, S6lctt«Ha*o*«4W 
Jh*> J: U 5 ^ * y ^©T * * * @S©**@fc(6«ic*-£ L 

[0 0 13] 

* y CifejM * ftfc£7~ *ffi-CR*B LT 
#*9«^a«rfT5ifcfcfc, wCO^a^^x-^ic 

[0 0 14] Sfc, J: aW^«*tea#ffiT? 

[0015] ±mffi&<D$/yi/XT&*tc\zm&m%r 




[0 0 16] 

[0 0 17] Bii:^^ *Hlfi«ttl-«S*^7^ 

^iofi, ssf^^at^sw^ « 

itfccDWMlfiit, :©ccDj«Mlfii© 
^ (cds) 0Bi2t, ^(Dffisz:a-y-v7 p y >r® 

Eg 1 2SrSfcCCDttJAfl^S:7 f ^/i'7 f -^^«*i" 
5DA3y/^^13«!r, ;«DA3^-^13*^ 
(DCCDRaw f*— fllMfti- ft**!) 1 4 CO 

^a^ft^a^7^^/^^tT9 7^^;vft^ 
a (dsp) 1 6 iSr^-rsflirictftoT^ao 
[ooi8] _Liaft&o#y 7^*7^1 oKjav^r, 
CCDittif 1 liLTtt, «;ttf, PS (^s^a 

fflttWHU - is wv^-u-*) jEfa:©*^*^ 

*ffl^5>tl5, r^DRAMi: LTfl, 0Sx.tf, 
[0 0 1 9] ^*/Ht»*ftaE*l 61*. */ym?r 

Ma^2 i , «/h*aaft2 2, EE«teas&2 3*3<ttf# 
«»a«S2 4*^J:or«**ixrv^ 0 ztofV** 
w^aieiKi eic^v^r, *^7ft^a^2if^ 

-J.^^-y 1 4|Ct&^^tlfcCCDRaw 7-*&, 7 K 

n y * *tt-c«*tH tr* * ?«»»a«rfii,5 • 

w(0*p«7«-S-*!ia-ett, CCDRaw x-*£YCbC 

r^-^^RGB^-^^aeifti-siaa^fftons. * 

[0 0 2 0] *fc, r^^/HlfM[H]iSl6l:io^ 

t\ *^?flr*«a»2 1, «/h««SB2 2, jEjs&a 
K2 3*5J:t«***a!a«2 4tt#*, o-^/v^^-y^ 

-^■$aa^2 l-0CCDRaw 7~* y ^ 

■rs J: 5 k Lfc r fc -e , ^ ^ 7«*«a« 2 1 1 jfi/ha 
age 2 2*5<fct/jEiBi^a^2 3 ^<oib, afet5ic#fi*o.a 
u 2 4 iig/hteatt 22^ (dfa^ * y 1 4 ^g^r 

[0021] ^v^r, ^^/Hi*»aiHi»i 6ic^tt 
z&mmu 21-24 o*#ttft»fPfcov^TR!Hi- 

[0022] 5ti\ * ^ 9m*&a« 2 1 -ew:, b 2 

^•TJ:5^, ^^H4|:-lfejW^fcCCDRawf 
-^«r, «aic*Kft*TO**x*iaic*JWtBEii 



-3- 




7K5pSK*lC5B*<OCCDRaw f^^blI$OT 
CbCrr^ (Xf4, RGBr-^) Sr^i-Sfc* 

[0 0 2 3] :^^7tl^M^^D';^tt-C 
<Tj>CCDRaw f-^0»*llJltt, 7K^M»0B1 

[0 0 2 4] Afrttfctt* /n^ttt^7S% 
MZftotmLX, *¥Mi£#iC5B^CCDRaw x 
-**>e> 1 IIWY CbCr x-* «r£fiM-*fcfcfc 
f4, te*fc^0^oy^^|»Sf-rSfe*©^oy^O«- 
y 4 > 2 Bi!f #T OOlSf-^ *3 J: tf±T<^n y * 

[0025] B3£*5^-c\ £*-c«8rt-s 

(C, ±T-C»«i-*2o<0^ny^|Ci3V^-C, BUM'S 

[0 0 2 6] Lfc#oT, 1 4fclMA3ftfcCC 

DRaw ^-^t^ny^Jlltt-CRfrUl+lcafco-Ctt, 

(8*, ^CCDRaw f-^Ho^ 

«) OCCDRaw f-^^O^Tlt n— 

[0 0 2 7] ^LT, #7<9{i^*Q!«f«2 1 fc*JV*T, 
*5pSiK#iC5H*OCCDRaw x — ^^E»lI*©Y 
CbCrr-^ (Xtt, RGBt-^) «rfe*+5fcft 

7«#*aa^J:o-C4rtSixfcYCbC rr-i? (X 
It, RGBt-^) 14, B4JC*-MlMC"C]fitC^ay^ 

[0 0 2 8] *^7«**Qfa«»2 ia>&tttfj**lfc:/n 

tte>oaa^gi#3ttv>Ttfi3ixttv>»&ici4, 7« 
»4, 1 4fc*ia*ftarfcfc48. 

[0 0 2 9] -fltLT, *^7«*teaic3ISttV^T 
EJIBfeajftSfftoixatOiri-Si:, YCbCr 4 : 2 : 
2<D J PEGOBttffi«*ffl5£Lfc»&K:, B5iC^1" 




yny^*fir(OA*f f -^Sr*¥2 OBSSStt 
121^ («T\ *fxf3RStyi*OXEt:xXy 
tftf) OCCDRaw f-^H, rcOCCDRaw x~ 
*£l 6 x80yn y ^(DYCbC rr-^ t LTKg 

[0 0 3 0] :©16X80^By;©YCbCr7- 
*£gttT, £*S&aS5 2 3f4, B6fc*1-i5l;:, B 
«ffi*8*Q.&£H*q<D J PEGfflffi&ffilCcfcoT^TU 

&U*S;h,fcJ PEGffiB? 5 -*^ ^ y 1 4 

[0031] *g/h&as&2 1 -e©»aicov^Ttt 

[0 0 3 2] B 7 14, ffi/h&lfflS 2 1 OAftWfc«j£<Z> 

-Wi*t^o7^B-e*)i. B7ic*3ivc, 

gff2 1f4> 7K¥LPF (o— 2 11,* 
¥RB3I#[hJ&2 1 2, n-*/M*y fc Lr<^«tBSr» 
Ol/^^ 2 1 3, IBLPF2 1 4*5j;tfSEflfl3lt 

0K2 1 5*tf-ra«j8fcfto-o** 0 

[0 0 3 3] Bfe4>tt'M&9tt* TK^^^i^K* 
l6j^*5V^B*7 f -^«rB3l<-t«-J:or*a"e# 
5. L*»Lft*b, ¥fcB*^-*S:W3lv\fc^l4B 

(c J: oT^iaB^coB^r-^ left LTfca«ft«**r 
rttboB*^— **rffiv^TiooB*f p — 

[0 0 3 4] zM*L P F 2 1 1 *> cfcU^iEL P F 2 1 4 
f4, rcoB J Rf^]±^^^{cS:it^^fc:tO-Cfo8o *L 
t\ *¥L P F 2 1 1 7 y y ^fel^fftohfc 
yns/^^-^jC^LT, *¥in3l#EIfc2 1 2"?* 
¥*rt©B9l#«a3»fftott6. r<7)7K¥LPF2 1 1 
*3 4;U j 7K¥W?I#[hIK2 1 2V®>m£tltz7vy?<D7* 

»«-t"SB*©HiR7 f -^»4, 1^**2 1 3fc*Mfl* 

[0 0 3 5] *WiH«>B9lt»I#ffto*ifcB«f f - 

*J4, ?lt^IS:LPF2 14-C7^^!)y^I 
jWTtoitS. :oltLPF2 14-C<07>f;^!)^ 
^S-Cf4, n y ^ i:» Lt t ©±TO 2 o 

[0 0 3 6] ^SL P F 2 1 4(C^o^T, ^77^:' 

sielpf 2 1 4-?mw.j7ft<Dy v y?tm 

2 1 5-cait*rtI0M3l#iBa* s fTbtt, 
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mix?-* kLxmxatis. 

[0 0 3 7] -fliLt, H8lC^-fi5lC, ;M?fI 
^&a§fl 2 1 frb$S'h&m& 22C16X8 CD^n y ? 
©YCbCrf-#»ilftAASn, rix£l/2f&lc 

[0038] :h*-c©Rn-ctt, **9ft**Mic9i 

[0 0 3 9] — flUrLT* YCbCr4 : 2 : 0£ J P 

EGtateufc**, ia9io^-rj:5«^ *iv*y 1 

4 KtMftSHT^-S CCDRaw r-^$:2 0 X2 0O^ 

^asp 2 l-ett^^^w^teasrtTofefti 6 x 1 6<d 

Zfu v * <DY C b C r T 5 -* fc L"C3B/h»a» 2 2 *3 <fc 
WB»*0a*2 3K^nsf^J|l|i-c4*.*. It 
/h«yffiffl 2 2 ttifeit Lfc#)B-rtB/h«M*rffo Tffi/Jv^ 
-^Srti^U ffi*8*&Sg&2 3ttfl»WJ PEGjE*§£ 
ffi-effittflMSrfTo-C J PEGffiBf-^tffl*t5. 
[0 0 4 0] 4*3, ±3*LfcBilftffi»B"ett, JPEG© 

[00 4 1] Sfc, ^Siia$r^i:i-^^^lc: N YCb 
C r 4 : 2 : 2 CCDRawr 5 — 6X12 

^d^^WU ^^7flfMi3 2X8^ 
ny^©YCbCr7 f -^tLttt)Alfc9, YCbC 
r 4 : 2 : 0 tf>»g\ CCDRaw 7*-* £3 6 X 2 0 (7) 
^ny^ttofflU *^7«tfeia3 2xi6^ 
ny^YCbCrf^t LTttiTJ Lfc 9 LT&a-f 

[0 0 4 2] -rte*>hs *^9«#»aic:*5v^, 

xll, SjEyWS x = 5, y = 5) 

YCbCr4:2:2 CCDRaw : *¥[nXl&*-l] ^Btf+y 

YCbCr :*¥[nxl6] S]K8 
YCbCr4:2:0 CCDRaw : *¥[nxifr+x-l] 

t\ nf4jE<0*»"C*>9, SUSttKHi, n = l, 2, 
4, 8i6S 9 

[0 0 4 3] #**W«2 4lE*JV^Tt, tR/hA 

a^2 2^j:t/ffi««!f3Stt2 3 tiawwc, ^d^W 
^a^fT^o r mi otc^i-^^iw, }g/jN«s 




SB 2 2^grt(+*t6n6*JS, 1 6 x 

[0 0 4 4] ±»Lfc<t5«C, BfWMWIHF\ «X.tfC 

*7*A1 0Ul*5V^C. CCDRaw f-^SrlgD RAM 
e^^^y 1 4K1— fifclAU CCDRaw 5*—* 

wirier »©J:5 4ffffl»*^»e>*v6. 
[0 0 4 5] 7>f^t-Ctt4<^ny^ 

*©»*rr*«!»«A*r««^#, LHCCDlt 

1 <nmmmm*-xhzti\ziE££tiz> z t 

<, *6*SiB*Wc#*:priBt4S. 
[0 0 4 6] Sfc, *y7«tfti^6R©«!ai:»fir 

-r 6gg(dp<*y u^iftv^ *^7«wi 

T^y 1 4^or^*^ia«4r*«tiimn-e*5ti: 
tic, ^^A^*oj|!|*«*Sr*«lcHB*t?#5 0 
[0 0 4 7] El 11 tt, W^lix^/^^-^^y^ 

7WA10' te, AD3WW13t^*!)14 

tom»c»a*a.aiiiKi 7*«fctRrt6*tfc«*i:ft 

[0 0 4 8] 9 S'^Al 

ott^ D CCDift^l lOnMRtf^ 

7u-^u-hSr±jf 6i«ftf*6r ccDi 
[0 0 4 9] ^oiB3l*»31tt, ^^'J^^*— KP» 

toa^a:*fRjico^rfctt"C$>^ 0 ifc^ot, r<D 
[0050] ^rr-c. *nis*«ic*5v^rtt, ^-~*y 
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v^-Kttfc, st;£fioK3ltK#oTccDg& 

w r-^tcttLT, gaaJOfSIeiK 1 7K:*5VvC*¥*Ir) 
<OB3l# (*/J>) aSSTT^* FJtlCtfJSLTfTofc 

w<D8fi©^S[H]Ki 7Wu 

So 

[00 5 1] 4*5, CCDiS^l llCttlBBRfcO 

(0«/h fcfr5*fctt* ft*)*;* 

[oo5 2] z<d±i\c, *-*y>y*-h-ma*, 

Sii[*lS<0(Hg|#^#5CCDRaw7 f -^^»U-C, 15 
StfttiHeMl 7TzK¥;frffl<&«'h (IH9I&) &3l£fTo 
fcflfc, i 4icte#rrs<fc 5KLfcri-c, 

y 1 4«Cf43f^OT^^^ hJtfc*ttSLfc CCDRaw 7 s 

W*Z<o9k<o**y l 4fc#+ST*ir*ia»£*lifc 

So 

[0 0 5 3] *fc, *^«il^§^^7^f^|: 

tt, CCDjHttfi i-e«lfcLfc!W»BiB«>-«^ 
gp^CCDM^i io*»Bi*«l«<o 5 

t>, »it*rtiTfOIB3lt«J:tK7k¥*«t?©*/ho*» 

*^*y 1 4^»jW$*LS. ^LT, r^CCDRawr 

[0 0 5 4] -SRSJOUiUOiBftSr^n^y 

fc/J^frfaft* 1 4lC»JWSttfcCCDRaw 7*- 

*fdS^T*~*y ^^Srtrofco-ett, E«K#K: 
IBft-rsii*^ X t ^=^-±^11^ X£ L4 

— OBffli£#fcEo-CS^$*iaJ: 5fc* CCDRaw t 

[00 5 5] wtL|C^-Ct6<t5(-i"5^«)(r, gj& 




<om*fa (****]) <o®ffi^xic«?i:T*^$ti 

So 

[0 0 5 6] ^ftlc^, — SB^O 0 m U<7)®^$r^-^^ 
•jV^i-SUMC, ^B&ldoi^Ttf) CCDRaw x— # 

7icisv^r*¥*fp]"est**ti,T^ 

^yi 4 iCttitt^ilfc CCDRaw x-*|Cg<5v>T^ 

So 

[0057] MjfriRilcBBL-Cfi, ^^ey 1 

4fcfMrt£iXfcCCDRaw x-^lCO^T, ^e~*-tf> 

So 

[0 0 5 8] 4*5, ±IE#SHS«»"Ctt, CCDft^ 

V^T, CCD»«Sf 1 l^bA*Sn*8WWB^ (C 
CDRawx-*) SrftS-t- 6»&lClo^T»^fc*^ # 

^7^xAic^it6»Mftffi^«!f3ffi^ise>i', ^y 

[0 0 5 9] 4fc, iE***^*^!!, 

fc^trc&So y ^ h ^^r-c^mLfc^(-f^ cc 

DRaw f-^^ES^y^^*!) ^-fi»3WU, t 
CO^ CCDRaw T^^^^U^b^n y ^*tt"C 

tim&ftozkXs ^r-r y v a y*y o^fflsi:^ / >4 

[0 0 6 0] 

-^->Sr-fiDRAM^O^^y IcKrtftU, Wyn^ 
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[02] 7fit ^iwawa^d y^f-^^t 

DRaw y f ~*<P#f8£^-0''Cfc£o 
[I215] YCbCr4 : 2 : 2 CD J P E G CQ®&H*8£ 
[0 6] EiM^ABA7-^^D ^(OWXS: 

[0 8] «/J«-COAWAf-^D^WX^ 
[0 9] YCbCr4 : 2 : 0 CD J PEG£ffi£LfcJ§ 



£^1-0-cfc£ o 

[sii] *&m<»m<Dnmmm\^&z>**y*s*'TJ* 

[012] X*yi/x : rJ*<Dfe%;W*7F't7Ky?m'? 
[013] x^^/Wf^SSKO^fig^-rypy^ 
[014] lU®^CCDtti^ffi-^<OHI^^^-r0-Cfc 

So 

[015] **yft^&m%yjy**V<nmf&M&* 
[016] ffi/h (Xtt, tt*) *&WI!?>f ^*!>©fll 
[ft^O&W] 

10, 10' •••i/yr^f^ li-CCDift^ 

^ i 2-ffiggraf-v7 p u (cds) 0s, 13 
hik, 1 a- -f^/Hi-wra (dsp) 0s, 17- 

5, 2 3-fflB««»* 2 4- 



[01] 



[02] 



,11 

CCD h° 
12 



X 



CDS 



A D □ >/<• 



r 

— LL 3 



1 6 x2>*/WffS»S (DSP) 



_-4i_-ii-^— -y- —fe 



~T~ 



tt: 



[H15] 



20 



"It 



A^JCCDRm 



A > 9 



a > 9 
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